Could quantum mechanics be an approximation to another theory? 
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We consider the hypothesis that quantum mechanics is an approximation to another, cosmological 
theory accurate only for the description of subsystems of the universe. Quantum theory is then to 
be derived from the cosmological theory by averaging over variables which are not internal to the 
subsystem, which may be considered non-local hidden variables. We find conditions for arriving at 
quantum mechanics through such a procedure. The key lesson is that the effect of the coupling to 
the external degrees of freedom introduces noise into the evolution of the system degrees of freedom, 
while preserving a notion of averaged conserved energy and time reversal invariance. 

These conditions imply that the effective description of the subsystem is Nelson's stochastic formu- 
lation of quantum theory. We show that Nelson's formulation is not, by itself, a classical stochastic 
theory as the conserved averaged energy is not a linear function of the probability density. We also 
investigate an argument of Wallstrom posed against the equivalence of Nelson's stochastic mechanics 
and quantum mechanics and show that, at least for a simple case, it is in error. 
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• The unresolved difficulties in extending quantum 
theory to cosmology. If this cannot be done then 
one possible explanation is that quantum mechan- 
ics does not in fact extend to the whole universe. 

„ r , . , . , . , , 1 L, mii st then be an approximation to a more fun- 

p. the implementation of the average conserved energy co ncutiorfi , , . rj T , . , , 
* ° °- cTalllt?ntal cosmological theory, which applies only 

for small subsystems of the universe. 

• The difficulties in solving the measurement prob- 
lem in the context of a theory with a realistic on- 
tology. 

• The success of quantum information theory, which 
reinforces the viewpoint that the quantum state 
represents the information that observers have of 
a system. 

• The experimental evidence against the Bell in- 
equalities tells us that any theory quantum me- 
chanics is derived from must be non-local. It is 
then natural to hypothesize that this non-local the- 
ory is a cosmological theory, which is more ade- 
quate than quantum mechanics for the investiga- 
tion of cosmological problems. 

These assertions raise issues about which there is dis- 
agreement and lively discussion. However, apart from 
taking the fact that these issues are unresolved as moti- 
vation, the aim of this paper is not to address that de- 
bate directly. Instead, we ask whether there are condi- 
tions that must be satisfied by any non-local, cosmolog- 
ical theory, so that quantum mechanics can be derived 
from it as an approximate description of subsystems. 

Given that locality is sometimes thought to be 
an almost sacred principle, it is perhaps an under- 
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I. INTRODUCTION 



In spite of much progress clarifying foundational is- 
sues in quantum mechanics, there remains persistent ev- 
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appreciated fact that there are non-local hidden vari- 
ables theories which reproduce the predictions of quan- 
tum mechanics. The best studied of these is Bohmian 
mechanics 1 1]. Others more recently proposed include 
the trace dynamics of Adler|2] and the approach de- 
scribed in 0]. 

In Bohm's theory the ontology includes both the parti- 
cle positions and the wavefunction, both of which live in 
the classical configuration space. If one believes that the 
particles are real one must also believe the wavefunction 
is real because it determines the actual trajectories of the 
particles. This allows us to have a realist interpretation 
which solves the measurement problem, but the cost is 
to believe in a double ontology. 

Is it possible to solve the measurement problem with a 
realistic ontology that is not doubled, as Bohm's is? The 
idea that quantum mechanics is an approximation to a 
non-local, cosmological theory offers a new possibility 
for doing this because the missing information, which 
makes quantum theory statistical, would be found, not 
in a more detailed description of a subsystem, as it is 
in Bohmian mechanics, but in hidden variables which 
describe relationships between the subsystem and the 
rest of the universe. 

Such a theory would begin with a non-quantum the- 
ory giving a precise description of a whole universe. 
The dynamics of this cosmological theory might be de- 
terministic or stochastic, but it must be non-local. One 
would choose a subsystem and then represent the rest 
of the universe, including possible non-local variables 
relating the subsystem to the rest of the universe, by a 
statistical ensemble. Averaging over this ensemble one 
would hope to arrive at quantum mechanics as a de- 
scription of the subsystem. Formulations of such a the- 
ory have been studied in |3, 4] and appear to work, at 
least to a leading approximation. 

In fact, there is independent motivation for believing 
that non-local interactions arise from microscopic theo- 
ries of spacetime These arise from the observation that 
locality can disordered in quantum states of geometry in 
loop quantum gravity and similar theories] 5, 6, 7]. This 
is possible because in such theories the classical metric 
is an emergent, approximate quantity, meaningful only 
at low energies. As a result, there can be a mismatch be- 
tween the notion of locality which controls the dynamics 
of the fundamental microscopic theory and a different 
notion of locality that follows from the emergent met- 
ric which controls the approximate, low energy, dynam- 
ics. This can happen in both quantum and stochastic dy- 
namics of discrete geometries|7]. Given the latter possi- 
bility it is possible to conjecture that a stochastic theory 
of pre-geometry is the cosmological theory which quan- 
tum theory approximates for subsystems. 

In this paper we ask what conditions must be im- 
posed so that a derivation along the lines just sketched 
would work. We begin with a classical Hamiltonian de- 
scription of the cosmological theory. This is probably 
not necessary, but we employ it for definiteness. The 



subsystem phase space variables will be given by the 
canonical pairs, (x a ,pb) while the remaining variables, 
both those local to the universe outside the subsystem 
and non-local variables connecting them, are denoted 
by pairs (y a , np). We will assume that the universe as a 
whole can be described statistically by means of a joint 
probability distribution p(x, y; p, tt, t), which evolves ac- 
cording to some kind of non-quantum evolution which 
could be classically deterministic or stochastic. 

We then want to know what conditions must be im- 
posed on the total system dynamics, or on the interac- 
tion between the subsystem and hidden variables, such 
that quantum mechanics can be derived as an approxi- 
mate description of the subsystem. 

To investigate this it is natural to employ the tools of 
stochastic differential equations as an intermediate step 
between the classical statistical mechanics of the cosmo- 
logical theory and the quantum mechanical description 
of the subsystem. This allows us to make use of the for- 
mulation of quantum theory in the language of stochas- 
tic dynamics, formulated by Nelson|8] and studied by 
he|9] and others 1 11]. Nelson's formulation is employed, 
not as a fundamental reformulation of quantum theory, 
but as a step in a derivation of quantum theory from 
a hidden variables theory. In the language of effective 
field theory we can say that Nelson's stochastic formu- 
lation of quantum mechanics is a kind of low energy, ap- 
proximate description of a small subsystem of the uni- 
verse. 

Having described the method, I can state the conclu- 
sions, which are a list of conditions required for quan- 
tum mechanics to be derived from a non-local cosmo- 
logical theory as a description of a small subsystem of 
the universe. 

• PI Averaging over the hidden variables induces 
a random noise in the evolution of the subsys- 
tem variables. This allows the subsystem to be 
described in terms of stochastic differential equa- 
tions. 

• P2 There is a notion of averaged energy in the sub- 
system, which is conserved in time. 

• P3 The averaging over the effects of the hidden 
variables does not impose a direction of time. Af- 
ter the hidden variables are averaged over the 
stochastic dynamics of the subsystem is invariant 
under time reversal. 

• P4 We can approximate the averaged dynamics 
by keeping terms only of lowest order in spacial 
and time derivatives. In particular, the probability 
current for the subsystem variables is assumed to 
be irrotational. 

The fourth condition is natural if we take the point of 
view in which we are extracting an approximation good 
for low energies. From this point of view it is natural to 
ask that the probability current be irrotational, because 



3 



in many cases of interest, such as fluid flow, this condi- 
tion can be satisfied by lowering the energy. 

We note that the second and third of these are very 
stringent conditions. It is often the case that when a sub- 
system is coupled to a reservoir, the subsystem degrees 
of freedom become stochastic. But usually the dynam- 
ical laws satisfied by their averaged quantities are nei- 
ther conservative nor time reversal invariant. Our con- 
ditions say that quantum mechanics could be an approx- 
imate description of a subsystem of a non-local theory 
only if these unlikely conditions are nevertheless satis- 
fied. 

This paper is organized as follows. We begin in the 
next section by presenting a formulation of Nelson's 
stochastic mechanics suitable for the purposes at hand. 
We do this to set the stage and also because employing 
Nelson's formulation in this way requires that we con- 
front and resolve some questions that have been raised 
about its adequacy as a formulation of quantum dynam- 
ics. We do so in the next section and in section IV. 

In the next section we clarify the use of probability 
in Nelson's formulation. In classical or quantum statis- 
tical mechanics the average of any observable is linear 
in the probability density. We show that this is not the 
case in Nelson's formulation, because the averaged en- 
ergy, which is conserved, depends non-linearly on the 
probability density in configuration space. More specif- 
ically, the energy of a system of particles at a point in 
their configuration space depends on the gradient of the 
probability density at that point. This makes Nelson's 
formulation similar to Bohm, in that the probability den- 
sity, which is a property of an ensemble, is playing a role 
influencing the motion of individual systems. 

If there is to be a clean derivation of quantum theory 
from a non-local hidden variables theory it must explain 
this non-linear dependence on the probability density 
of subsystem variables in terms of a linear dependence 
on the probability density of the non-local hidden vari- 
ables. The key question is whether and when this is 
possible. This is the task of section III where we will 
provide conditions under which the formulation of sec- 
tion II may be derived as an approximation to a more 
fundamental theory. We see that the key condition that 
must be satisfied for this to be the case is time reversal 
invariance. 

Finally, in section IV we discuss a criticism of Nelson's 
formulation given by Wallstrom| 12] and show that, in 
the simple case of quantum mechanics on a circle, it 
leads to the wrong conclusion. 



II. QUANTUM THEORY AS A FORM OF STOCHASTIC 
DYNAMICS 

The basic idea of Nelson is that quantum physics 
arises from an irreducible Brownian motion on the con- 
figuration space of a system which has, however, the 
unusual property that it is non-dissipative. That is, in 



spite of the fact that there is an irreducible noise in the 
evolution of the configuration variables, there is still an 
average conserved energy. In this section we want to 
understand clearly how this is possible. We employ an 
effective Hamiltonian approach as this allows us to un- 
derstand Nelson's formulation as a low energy effective 
description of a more fundamental theory. 

A. The implementation of stochastic dynamics. 

We start with a review of the basic formulation of 
stochastic differential equations. For more details see 

miia. 

We consider a system consisting of degrees of free- 
dom, (x a ) where a = 1,...N, We assume there is a met- 
ric q a b on the configuration space of the x a 's. We posit 
a probability distribution p(x a ,t) and a probability cur- 
rent v a (x, t), related by the conservation law 

dp = dpv a 

dt dx a ( ' 

This preserves the normalization condition that proba- 
bilities add up to one. 

J d n xp(x) = 1 (2) 

We assume also that the evolution of the x a 's is subject 
to a noise, so that it must be described by a stochastic 
differential equation, 

dx a = b a dt + dw a , (3) 

with 

(dw a dw b ) = 2vdtq ah . (4) 

for dt > 0, with diffusion constant v. 
For dt < 0, we have instead, 

dx* a =b* a dt + dw* a , (5) 

with 

(dw* a dw* b ) = -2vdtq ah . (6) 

These imply the Fokker-Planck equations 

p = -V a {pb a ) + zA7 2 p 

p = V a (pb* a )-uV 2 p (7) 

If we define the current velocity v a by 

v a = ^(b a + b* a ) (8) 

we recover the conservation law for probability Q. 

We then define the difference of the forward and back- 
wards velocities to be the osmotic velocity 

u a = \{b a -b* a ) (9) 



4 



The Fokker-Planck equations then imply 

u a = vq ab V b \np (10) 

This extremely interesting relation will turn out to be the 
key to the mystery of how stochastic mechanics works. 
It tells us that the difference between the forward and 
backwards current velocity is related to the derivative 
of the probability density It is important to note that 
this is a general property of Brownian motion. It also 
reminds us that, like p, b a and b* a are properties, not of 
individual histories of the system, but of an ensemble of 
histories. 

We are used to the idea that in statistical mechanics 
averages over ensembles give us predictions for where 
we are likely to find an individual,typical system in the 
ensemble. But we see that in Brownian motion some- 
thing a bit more is involved, because properties of the 
probability distribution at one time give us information 
about the dynamics of the ensemble and hence, to some 
extent about the future or past behavior of individual 
systems. 

We will be later interested in the properties of these 
observables under time reversal invariance t —> —t 

b a ^-b* a , v a ^-v a ,u a ^u a (11) 

These last equations, Q to tilt define a general sys- 
tem subject to a brownian motion and so realizes PI. 

B. The implementation of the average conserved energy 
condition 

We now describe how we implement the condition 
P2-P4. The first of these asserts that there is an equi- 
librium state in which there is an averaged conserved 
energy. We require that there is a function H of the vari- 
ables that describe the stochastic process that satisfies 
the following conditions. 

• H is a function of p, v a (x) and position. 

• H is conserved in time, (P2). 

• H is invariant under time reversal invariance, (P3). 

• H contains only those terms that dominate in the 
low velocity and long long wavelength limit (P4). 

• The current velocity v a (x) is irrotational (P4). 

It is also reasonable to impose the following condi- 
tion, to ensure stability 

• H is positive definite. 

Finally, it is natural to demand the following two con- 
ditions: 

• H is invariant under rotations among the x a 's. 



• H is local, so it is of the form 

H = J d N xH (12) 

where H is a density. 

We now proceed to define the form of the effective 
hamiltonian from these conditions. 

The only density available to us is p. Hence we have 

H = ph (13) 

here h is a scalar function of density weight zero, of p 
and v a . As p is a density the only way h can depend on 
p is by depending on u a , which by is a vector. As h 
must be rotationally invariant it can depend only on v 2 , 
u 2 and v ■ u. Of these v 2 and u 2 are time reversal invari- 
ant, but u ■ v is not. Hence the lowest order dependence 
possible on u ■ v is through (u ■ v) 2 . 

Furthermore, p and v a may be independently speci- 
fied as initial data, subject only to as p is determined 
by the conservation law Q. For the long wavelength 
limit we should also include terms with as few deriva- 
tives as possible. Hence, putting all the conditions but 
the last together, we have 

h(x) = F 1 [v 2 ]+F 2 [u 2 } + F 3 [(u-v) 2 }+U{x) 

+ terms in dv and du (14) 

where the Fj are positive definite functions and U (x) is 
a positive, time independent, function of the x a 's, which 
of course is a potential energy. 

For small velocities we may expand Fi as 

Fl [a*\ = + * + ...] (15) 

where m > has dimensions of mass, c has dimensions 
of velocity, and F 2 has the same behavior. F 3 starts at 
order (u ■ v) 2 /c 2 . 

Hence, for small velocities h is then required by the 
condition P4 to be of the form, 

h(x) = ^v 2 + h -u 2 +U{x) (16) 

where m.b > 0. 

We note that if b = H is just the averaged energy of 
an ensemble of classical systems. Thus we can identify 
m as the mass. 

If we want to get something different from classical 
physics, we then want b > which gives us a term in 
the averaged energy 

H quantum = J d N Xp^U 2 = ^- / d N Xp( V 111 pf (17) 

This term is significant because, as we will see, it gives 
rise to the quantity that in Bohm's formulation is called 
the "quantum potential". It is thus the key to how 
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stochastic dynamics becomes quantum mechanics, and 
we will seek to understand it better once we have com- 
pleted the derivation. 

We now impose the condition that the motion is irro- 
tational, so that 



dv a 

dx 5 



dx" 







This implies there is a function S(x) such that 



—q 

771 



, dS 
dx b 



(18) 



(19) 



The m is put there for later convenience. 



C. Derivation of the Schroedinger equation 

We are now ready to give the derivation of the 
Schroedinger equation. 

Using £5) the conserved average energy is now given 
by 

H = / P (i (V ^ )2 + ^" (Valn/9)2+ ") (20) 
We now impose conservation of the averaged energy 

J y 2m 2 p A 

+2\7 a -\7 aP )]~S^-\7 a (p\7S)\ (21) 
p 2m J 



Now we use Q and fj"9l which imply 

1 



-V a ( P V Q S), 



which give us 



1 



s+—(v a sy+u-—( 

2m 



(22) 



2V a -V a( o) 



This is solved for all ps if the integrand is zero: 



(23) 



= S+^-(W a S) 2 +U- b -^(^^ + 2W a -W a p) (24) 
2m 2 p z p 



But this last eq &24\ and d22> are the real and imaginary 
parts of the Schrodinger equation. To see this, we define 
ft by 



tl = v\l mb 

We then define the wavefunction, 



(25) 



(26) 



It is then straightforward that eq j24l and 422J are the 
real and imaginary parts of 



in—— = 

dt 



(27) 



This provides a derivation of Nelson's stochastic for- 
mulation of quantum theory, showing the importance of 
the assumptions of a positive averaged squared energy 
and time reversal invariance. 



D. The scene of the crime 

We see from this derivation that the key point which 
separates quantum mechanics from a statistical ensem- 
ble of classical, conserved systems is the term H quantU m, 
eq. \17\ in the averaged conserved energy. 

This gives rise to the term proportional to b, and hence 



ft , in J24t . In fact this is the only place ft appears in the 
coupled equations i24i and 1221 . This term is called, in 
Bohm's formulation, the quantum potential. In Bohm's 
theory, this is the origin of the effect by which the wave- 
function guides the motion of the particle (it is hence the 
pilot in the pilot- wave theory.) The claim that Nelson's 
formulation provides an alternative to Bohm that is re- 
alist but without a dualist ontology rests on the claim 
that this term arises from the stochastic fluctuations of 
the particle. Let us then examine how this term appears. 

In the derivation just given, we opened the door to 
the possibility of quantum theory when we posited that 
the energy at a point in configuration space, h(x) could 
be a function not only of position but of properties of 
the ensemble such as v a and u a . Is this permissible? At 
first sight, it would seem an innocuous assumption. If 
we want to get the dynamics of a classical ensemble of 
conserved systems, we have to include in h(x) a term 
proportional to v 2 . But once we have this term, why not 
include also a term proportional to tt 2 ? 

The difference is that v a is at a single time an indepen- 
dent quantity, whereas u a is determined by the Fokker- 
Planck equation to be equal to vV a In p. Thus, including 
terms in u a in the energy make it a function itself of the 
probability density. To avoid this we should have set 
b = which would have implied ft = 0. 

The issue is that when we write the definition of an 
ensemble average of energy as 



H = / d N xp[x)h{x) 



(28) 



we expect that h(x) is a property of an individual trajec- 
tory, i.e. the energy of a particle at x, and that the proper- 
ties of the ensemble are reflected completely in the linear 
explicit dependence on p. This expectation would seem 
to rule out h being itself a function of p. However it is, if 
it is a function of u a and the ensemble is Brownian. 

This makes clear that Nelson's is not simply a theory 
of an ensemble of particles undergoing Brownian mo- 
tion. For if, as this derivation suggests, it is meaningful 
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to interpret h(x) as the energy of a quantum particle at a 
point x, the energy of that particle depends on the gra- 
dient of the probability density at that point. To put this 
another way it costs a lot of energy for a particle to be at 
a point where the gradient of the probability density-in 
the ensemble of which it is a member- is large. 

One could take two points of view about this. One 
could, first of all, simple assume that the energy of a particle 
can depend on the gradient of the probability for an ensemble 
it is a part of. Then we are giving the ensemble a phys- 
ical, causative role it cannot have in ordinary classical 
physics. This implies that Nelson's stochastic mechan- 
ics is much closer to Bohm than seems at first, in that 
the particles in a system are not the only entities that 
must be posited to have a deterministic dynamics, for 
properties of the ensemble play a role in the dynamics 
of individual systems. This seems to come close to giv- 
ing the ensemble probabiltiy an ontological status close 
to, if not identical to, that of the wavefunction in Bohm's 
theory. 

We might on the other hand, try to argue that this non- 
linear dependence of the energy of a particle on V In p(x) 
results from averaging over a distribution of non-local 
hidden variables. This would be to explain Nelson from 
a deeper theory, as investigated in [3, 4]. We see here that 
the key point of such a derivation must be to cause the 
dynamics of a single observable to depend non-linearly 
on its own probability distribution. It is possible that 
this could come from averaging over an ensemble of 
hidden variables, as argued in |3, 4], but if so we should 
see in detail how it works. 

This is the task of the next section. 



III. DERIVING NELSON FROM A HIDDEN 
VARIABLES THEORY 

Having clarified the assumptions behind Nelson's 
stochastic formulation of quantum mechanics we turn to 
the main question of the paper, which is when and how 
those assumptions can be consequences of a non-local 
hidden variables theory 



A. Schema for a non-local hidden variables theory 

Here is one schema for how a derivation of quantum 
mechanics from a more fundamental theory can go: The 
more fundamental theory has configuration observables 
(x a ,y a ) where x a label the configuration space of the 
subsystem which is to be described by quantum me- 
chanics and y a stands for the hidden variables. Con- 
jugate to them are momentum observables (p a ,ir a ). 

The evolution of the system is governed by a joint 
Hamiltonian 

H = H subsystern {x,p) + H hldden (y, tt) + H mt (x, y,p, tt) 

(29) 



To evade Bell's theorem we have to assume that H mt 
introduces interactions which are non-local in the con- 
figuration space of the subsystem, and we will assume 
this is the case. We assume a standard form for 

H = H subs y* tem (x,p) = ^- q ab PaPb + U{x) (30) 

where q ab is the inverse metric on the configuration 
space of the subsystem. 

The statistical state of the system is described by a 
probability density on phase space T, p[x,y;p,n]. The 
expectation values of observables 0[x, y;p, tt] are given 
by 



< O >= 



po 



(31) 



To make the connection with quantum theory we will 
assume that the solution of the joint dynamics is given 
by a solution of the Hamilton-Jacobi function S(x,y) on 
the joint configuration space. Then we may consider a 
statistical distribution holding S fixed 

ps[x,y;p,Tt] =p(x,y)J[6(p a - i£) JJtf(p a - |^) 



5y° 



We can then write, on solutions, 



Pa 



ss 

Sx a 



mq ab x b (x,y) 



(32) 



(33) 



Where we have written x b (x, y) to indicate that the ve- 
locities given by the solution S(x, y) are functions of 
both the position in the configuration space of the sub- 
system, x a and the hidden variables y a . It is this depen- 
dence that can carry the non-local couplings necessary 
for a non-local hidden variables theory. 
This lets us write 



subsystem > = \ dxdy ~ p(x ^ v) ^q ab x a ( X , y)x»(x, y) 



-V(x)] 



(34) 



We will also need the probability distribution on the 
configuration space of the subsystem 



p(x) = / dyp(x, y) 



(35) 



B. Derivation of stochastic dynamics 

We can now turn our attention to the conditions 
needed to reproduce the derivation of quantum theory 
in the previous section. We are particularly concerned 
with the derivation of the term that becomes the quan- 
tum potential 1171 . 

We will assume that 



< H mt >= 



(36) 
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and that < H hldden > is separately conserved or may 
be neglected. This gives us a separate conservation of 

^ ^subsystem \ ^ q 



^ ^ jLf subsystem ^ 
dt 



= 



(37) 



To investigate the implications of this we turn our at- 
tention to the kinetic energy term 



k {x,y) = —q a bX a {x,y)x b (x,y) 
The expectation value of the kinetic energy is then 



(38) 



< k >- 



dy I dxp(x,y)—x 2 (x,y) (39) 



With the hidden variables specified the velocities can 
be assumed to exist, so that we can write 

,/ x 171 ,• f x (t + dt)(x, y) — x\ 2 

ajar — *~- J (40) 

We write x{t + dt)(x, y) to indicate that the position of 
the particle a time dt into the future is a function of both 
x and the hidden variables y. We write the square from 
now on as a shorthand. 

Since the path in the joint configuration space of x and 
y is assumed to be differentiable we can write this just 
as well as 



k(x,y) 



— lim 

4 dt^O 



o(t + dt)(x, y) — x 
dt 



x — x(t — dt){x, y) 
dt 



(41) 



We will see shortly that the second form, d4ll is prefer- 
able because it preserves invariance under time rever- 
sal for finite dt. This can matter because, once we aver- 
age over the ensemble of hidden variables, the paths in 
configuration space of the subsystem are Brownian and 
hence are no longer differentiable. 

We can then write 



< k > = dy d N xp(x,y) — lim 
J J 4 dt^O 



x — x(t — dt)(x, y) 
di 



where b a (x, t) is not a function of the hidden variables 
but the fluctuations dw a are. Similarly we write 

x a -x a (t-dt)(x,y) =b* a {x,t)dt + dw* a {x,y) (44) 

We then assume we can integrate over the y's , giv- 
ing an ensemble of Brownian trajectories satisfying the 
earlier equations such that 



x(t + dt){x, y) — x 
dt 



dxdyp(x,y)F{x,y) = (F) 



(45) 



However, before doing the y integral in eq. J42I we have 
to exchange the order of that integral with the limit dt — > 
0. This is because the individual paths of the Brownian 
particles are not differentiable. 

This exchange of orders of integration and a limit is 
a crucial assumption. The result, as we will now see, is 
to trade the dependence of the averaged energy on the 
time derivative of an individual path with a dependence 
on the spatial derivative of the probability distribution 
of the ensemble of Brownian paths. 

Just when is this exchange of limits and integral al- 
lowed? We can recall that the notion that paths of Brow- 
nian motion particles are not differentiable is meant to 
be an approximation good when averaging over time 
scales long compared to some microscopic time scale r. 
For times smaller than r the paths can be resolved into 
differentiable paths, while for time scales longer than r 
there is so much chaos in the paths that it is most useful 
to understand the dynamics in terms of an ensemble of 
Brownian particles. 

The crucial step is the change of description from one 
in terms of motion on a joint configuration space of ob- 
servables and hidden variables to a Brownian ensemble 
of trajectories just of the x a 's. This should then be un- 
derstood as a change of veiwpoint from following the 
joint trajectories precisely in time and one in which time 
is not resolved below the scale r. 

The exchange of order of limit and integral has to be 
understood in this light. By the assumption that 



dy lim = lim / dy 

dt^O dt^O 



(46) 



e mean more precisely that an approximation is being 
made in which 



(42) 



We now want to integrate over the hidden variables, 
which requires that we express the dynanics of the po- 
sitions x a not as ordinary variables but in terms of 
stochastic differential equations. That is, we assume that 
the dependence on the hidden variables y is responsible 
for the variance in an ensemble over trajectories in the 
x a . This lets us write. 

x a (t + dt)(x,y) -x a = b a (x,t)dt + dw a (x,y) (43) 



dy lim ~ lim / dy. 

y dt ^o dt- ' 



(47) 



Let us make this assumption and see where it leads. 
We then have from J42t 



< k >= lim — I dy I d N xp(x, y) 

dt^O A J J 



(48) 



x(t + dt){x, y) — x 
dt 



x — x(t — dt){x, y) ' 
dt 
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Using 1431441 this is 



7 V m 

< k >= lim — 

dt^r 4 



dy \ d N xp(x,y) 
) 2 + (- 



b a {x, t)dt + dw a {x, y) 2 b* a {x, t)dt + A*w a {x, y) ^ 2 
dt ' + < " It 



(49) 

) 



We can then take the average and the limit to find 

<K> = j J d N xp(x) [b 2 + b* 2 ] +C + 0(t) 

= y J d N x P (x) [v 2 + u* 2 ] + C + O(r)(50) 

where 0(t) denotes terms that vanish as r — > and C is 
a constant 



TO 



(51) 



Should we worry that the averaged conserved energy 
shifts by a constant that becomes infinite as r — > 0? 
There is nothing to worry about because we are employ- 
ing the principle that the average energy is conserved in 
time. Shifting it by a large or even infinite constant does 
not affect its constancy in time. 



C. The importance of time reversal invariance 



The correct values of a and /3 then depend on the 
physics that allows the exchange of the limit and inte- 
gral. Here the assumption of time reversal invariance 
plays the key role. This is a physical assumption, be- 
cause it affects the outcome. The point is that for finite 
dt the expressions d40t is not invariant under time re- 
versal, whereas 14 It is. If we insist that the physics re- 
spects time reversal invariance then the derivation must 
resp ect this assumption at each step and we must choose 
14 it . This leads to the result <5U> , which is the form of the 
averaged conserved energy that gives the Schroedinger 
equation|il4ll. 

The conclusion is that quantum mechanics is a con- 
sequence of the more fundamental theory envisioned in 
these derivations only if the effect of the hidden vari- 
ables on the observables does not disturb the time re- 
versal invariance. We note that in many circumstances 
in which a system is put into interaction with a reservoir, 
the effect of the reservoir is to make the system tend to 
equilibrium, which gives a preferred direction of time to 
the thermodynamics of the system. If hidden variables 
are responsible for quantum dynamics, their effect must 
be to disorder the dynamics of the observable quanti- 
ties in a way that preserves both the conservation of an 
average conserved energy and the time reversal invari- 
ance of the evolution of the ensemble representing the 
system. 



There is a subtle issue buried in the derivation we 
have just described that needs to be discussed, as it 
makes clear the importance of the assumption of time re- 
versal invariance. Assuming that the paths are smooth it 
seems we could equally well express the kinetic energy 
as (40) or <4H or in general as 



k(x,y) = 



m 

— lim 

4 dt^O 



x(t + dt)(x, y) — x 
dt 



+(3 



x — x(t — dt){x, y) 
dt 



(52) 



where a + (3 = 1. As long as the paths are smooth these 
are equal for any choice of a. But following the deriva- 
tion through this would lead to 

< K >= j J d N xp(x) [v 2 + u* 2 + 2(a -0)vu]+C 

(53) 

This is not equal to <50t . There must then be something 
wrong with the argument. The point is that, as empha- 
sized above, at the point where the exchange of a limit 
and an integral is made, the expressons are no longer 
equalities but approximations, good only to the extent 
that the exchange of orders is permissible. This is per- 
missible only if we are studying quantities averaged in 
time over a time scale greater than r, such that the ex- 
change of the limit and the integral is a good approxi- 
mation. 



IV. ANSWERING WALLSTROMS OBJECTIONS TO 
NELSON 

In m Wallstrom made an objection to Nelson's 
stochastic mechanics, which seems at first formidable, 
but has a straightforward answer, at least for simple 
cases. 

To discuss Wallstrom's objection it is simplest to con- 
sider the case of quantum mechanics on a circle. The 
independent variables of Nelson's formulation are then 
a current velocity v(9) and a probability density p(9). 
These are defined on a circle parameterized by 9. These 
are connected by the law of current conservation 

P = d(pv) (54) 
We then have locally-but not necessarily globally, 



v = —os 

m 



(55) 



for a function S. The local evolution equations are, in 
addition to 1541 . 



s = ±(dsf + u+ b -^( (dp)2 

2m 



, , , 2d(-dp) (56) 
2 V P P 



Let us consider the simple case where U = 0. There are 
then simple solutions of the form 



P= 2^ v (°) = w 



(57) 
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for any constant current velocity w. These correspond to 
a constant density and the particle moving around the 
circle with an arbitrary velocity. Locally, we then have 

5" = wm + cot (58) 

The dynamical equation <56> fixes the frequency 



One then forms 

4>(0,t) = Jpe l i = -^— e ^ mw ®-^) (60) 

Wallstrom's objection is then that , ip{6, t) is not a quan- 
tum state because it is not single valued and smooth on S 1 . 

We may note, as a first reply, that this does not apply 
to the ground state where S = 0. Even if Nelson's pro- 
cedure is able to only construct the ground state that is 
enough to reproduce perturbative quantum field theory 
from the expectation value of local observables. 

However, there is a more general response to the ob- 
jection. It is simply incorrect, because there is abso- 
lutely no reason a quantum state cannot be discontin- 
uous at one point, or at many points. The Hilbert space 
is £ 2 (5' 1 ), and it is well known that almost every state in 
£ 2 (S' 1 ) is discontinuous at one or even an infinite num- 
ber of points. In fact, the states 1601 are normalizable 
elements of £ 2 (5 J ) and their current velocities are well 
defined everywhere onS 1 . 

Since the states l!60> are in the Hilbert space, they must 
correspond to solutions to Nelson's equations, if Nel- 
son's formulation is to correspond to quantum mechan- 
ics. Thus, these states, rather then being counterexam- 
ples to the correspondence are a necessary consequence 
of it. 

What is true is that the state < !60i is not an eigenstate 
of momentum. This is because it fails to satisfy 

[ptf](0) = [-ihdi£](8) = hmw^{6) (61) 

at every point on the circle. Were it an eigenstate of 
momentum w would be quantized. But a generic state 
cannot satisfy this condition, all that is required is that 
it be equal to a superposition of eigenstates, which by 
Fourier's theorem it is. 

Furthermore, *f?(9) has a well defined evolution under 
the Schroedinger equation. It is a solution to < !54i and 
(56), which are just the real and imaginary parts of the 
Schroedinger equation. 

Wallstrom's objection is thus answered for the case 
of quantum mechanics on the circle. The objection has 
been made as well, for the case of wavefunctions on a 
general configuration space. Bacciagaluppi and Valen- 
tini have suggested that the map between solutions to 
Nelson's equations and states in the quantum Hilbert 
space could have obstructions or ambiguities in cases 
where the quantum state has several nodes 1 13], but this 



issue has not been treated in detail. One may also ar- 
gue that states must be differentiable for the action of 
the Hamiltonian to be defined, which would imply that 
most of C 2 of a configuration space are not good quan- 
tum states. However, as the above example illustrates, 
both the expectation value of the energy and the time 
evolution are well defined for all solutions to Nelson's 
equations. Hence, Nelson's formulation may be argued 
to provide a definition of the action of the Hamiltonian 
for such cases. 



V. CONCLUSIONS 

In this paper we have made a careful study of the 
question of when quantum theory can be derived from 
a non-local hidden variables theory, as an approxima- 
tion to another, non-quantum theory. This is relevant 
for attempts to derive quantum theory from non-local 
hidden variables theories as in While the dis- 

cussion hinged on some seemingly technical points, it 
brought out key conditions that must be satisfied if such 
a derivation is to succeed. 

The scene of the crime, so to speak, is the origin of the 
term which leads to the quantum potential, \17\ . This 
is the crucial term in Bohm's formulation by which the 
wavefunction guides the particle, it is hence the reason 
why the wavefunction has, in Bohm's formulation, to 
be considered as real as the particle. We see that in Nel- 
son it gives the probability density a non-classical role 
as it gives a contribution to the energy of an individual 
system that depends on the gradient of its probability 
density. Hence, by the presence of this term, Nelson's 
formulation seems to give the ensemble a non-classical 
meaning, thus failing to avoid the doubled ontology of 
Bohm. 

Could this issue be resolved by deriving the term 
from a non-local hidden variables theory? We gave a 
derivation suggesting that it could be. However a look 
at the details reveals the conditions that must be satis- 
fied for the derivation to succeed. Among these is that 
the stochastic dynamics of the subsystem which results 
have strict averaged energy conservation and invariance 
under time reversal. This is not impossible, but we note 
that it is contrary to the expectations suggested by our 
experience with ordinary statistical mechanics. There, 
coupling to a reservoir of degrees of freedom results in 
violations of both energy conservation and time reversal 
invariance. 

However in the approaches studied in we are in 
a very different situation from ordinary thermodynam- 
ics, because the interactions between the reservoir and 
system are mediated, not by heat flow across a wall, but 
by a network of non-local interactions. These are given 
by off diagonal matrix elements in Adler's formulation 
and by explicit non-local interactions in the formulation 
in 1 3]. It is then not impossible that the conditions found 
here to be necessary could be satisfied 1 15]. 
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Finally, we discussed the objection of Wallstrom|12] 
which is often mentioned as a reason why Nelson's for- 
mulation must be inequivalent to quantum theory. We 
see by studying the example of quantum mechanics on 
a circle that the argument fails in that case. Instead, the 
solutions of Nelson's formulation thought to be prob- 
lematic are required because they correspond to states 
whose wavefunctions are discontinuous but, being in 
£ 2 (S' 1 ) are in the Hilbert space of quantum theory. 
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